FLAG KERNELS OF ARBITRARY ORDER 
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Abstract. We extend the notion of a flag kernel to distributions of arbitrary order. 
Under some natural restrictions on order, we get a kind of functional calculus for 
thus generalized flag kernels. 



Introduction 

In the study of flag kernels it is sometimes convenient to work with a broader 
class of kernels, cf. [1] and [Sj- In this paper we introduce a class of tempered 
distributions generalizing homogenous distributions smooth away from the origin 
and containing the flag kernels of Nagel-Ricci-Stein [6] as objects of order 0. As 
a preliminary step it seems only natural to consider first what we might call 
Calderon-Zygmund kernels of arbitrary order. 

Let a G R. We say that a distribution P € S*{V) is a T [a) -kernel if it is 
smooth away from the origin and satisfies the following conditions: 

Size condition: For every multiindex a, 

(0.1) \D'^P{x)\<Ca\x\''-\''\ x/0. 

Cancellation condition: There exists a norm || • || in the Schwartz space SiV) 
such that for every ip G S{V) and every i? > 



(0.2) 



ip{Rx)P{x) dx 



In a similar fashion (see below) we generalize the notion of a flag kernel. 

Our goal is to extend the usual convolution of functions on a homogenous group 
to the class of thus generalized flag kernels. This is not always possible as can be 
seen from simple examples. However, under some natural restrictions on order, we 
get a kind of functional calculus. The classes of flag kernels considered here have 
their smooth counterparts in the classes described in [3j whose properties may be 
transferred into the new context under study. Let us add that this nonsmooth 
calculus has already proved useful in the proof of the L^-boundedness of flag 
kernels in [S^j. The reader may wish to compare our resuts with those of Geller- 
Core |1J where a very different approach has been taken. 

The techniques used in the first section are a slight extension of those of Nagel- 
Ricci-Stein [6J. All proofs are included for the sake of completness. On the back- 
ground theory of homogeneous groups the reader is referred to Folland-Stein [2] . 
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1. Flag kernels 

Let F be a finite-dimensional real vector space with a fixed family of non- 
isotropic dilations x ^ tx , t > 0, their exponents of homogeneity being 

1 = pi < P2 < ■ ■ ■ < Pd- 

We have 

d 

y = Vj, Vj = {x eV ■.tx = tP^x}. 

The homogenous norm | • | on F induces "partial" homogeneous norms 

\x\j = \{xi,X2,...,Xj,0,...,0)\, l<j<d, 
corresponding to the filtration 

k 

(1.1) ^(,)=0F., l<k<d. 

In particular, \x\i = \xi\, and \x\d = \x\. The homogeneous dimension of V is 

d 

Q = ^Qj, Qj = pj dim Vj . 
j=i 

There exists a corresponding homogeneous structure on the dual space V* so 
a similar notation applies to V*. However, here we let 

leii = i(o,...,o,c,-,o+i,---,Cd)i, i<j<d, 

the corresponding filtration being 

d 

(1.2) ^(-^^=0^*, l<k<d. 

j=k 

In particular, = |^|, and \C\d = \Cd\- 

In expressions like or x" we shall use multiindices 

a = (0:1,02, . . ■,ad), 

where 

"fc = (ofci, afe2, • • • , OfenJ, rik = dim Vfc = dimV^, 
arc themselves multiindices with positive integer entries corresponding to the 
spaces Vfe or Vj^. The homogeneous length of a is defined by 

d 

l«l = X! 1"^!' \(^k\=nkPk- 

k=l 

We define the class J^(z^) by induction on the homogeneous step d. If d = 1, 
that has been already done in Introduction. If d > 2 and u = (z^i, . . . , f^), then 
P € J^ii') if P is a tempered distribution smooth away from the hyperspace 

xi = and satisfying 

(1.3) |L>"P(x)| <C„|x|-"^~'^^~l"il|x|-"^"^^"l"^l...|x|-"'^-^'^"l"'^l 
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for xi 7^ 0. Moreover, for any 1 < j < d, there exists a norm || • || in S{Vj) such 
that 

(1.4) < Pr^^J >= R-"^ (p{Rxj)f{xi,...,Xj_i,Xj+i,...,Xd)P{x)dx 
is in J^{u') on Vi e • • • © Vj^i Vj+i © ■ ■ ■ © V^, where 

and this is uniform in 99 G ^i^j) of norm 1 and i? > 0. Let us remark that if 
I'j < for all j, then p.3|) implies (|1.4|) . The definition is relative to the filtration 
The flag kernels on V* will be understood as relative to (|1.2|) . 
It follows directly from the definition that 

1.5. Lemma. If P G then x"'D^P e J^ijj), where jik = T^k + \oik\ — |/3fc|. 
The next lemma is an easy corollary to the Arzela-Ascoli theorem. 

1.6. Lemma. Let ip G C^iV) he equal to 1 in a neighbourhood of 0. For e > 0, 
let ipe{x) = ip{ex). Let P G J^{i^)- Then = ipi^P are a uniformly bounded 
family of compactly supported distributions in J'{i^)- Moreover, P^ ^ P in the 
sense of distributions, and PeiO ~^ in C°°{V*) away from the hyperspace 

= as e — > 0. 

The following proposition is the main objective of this section. 

1.7. Proposition. P G implies P G J'{^j), where ^k = ~Qk ~ T^k- 

Proof. In view of Lemma 11.61 we may assume that P has compact support. 
Then P is a smooth function, and D°'P is a Fourier transform of {—ix)°^P G 
J^{i'i — \ai\, . . . ,Uii — \ad\) so it is enough to show that 

|p(e)l<c|cl^...|el^^ \^d\>o, 

and check the cancellation condition. 

Let us first consider the case d = 1. Let v = a. Let be a compactly supported 
smooth fuction equal to 1 on the support of P. Then for every [^| > 1 

and 

e-Mieix) = ve(ieix), 

where the family ip^ is bounded in S{V). Therefore, by (|U.2p . 

(1.8) m)\<c\cr, ici>i. 

However, the dilates < Pr,, / >=< P, fo5ji > satisfy the same estimate uniformly 
in R so (|1.8p holds for |^| > 0. As for the cancellation property, by (jU.ip . 

\ < P,(po6R> \ = R-^\ < P, ^ O 5ji-i > I < ||v9||P"'3~a 

for a suitable norm in S{V*). 
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Assume that our claim holds for 1 < d' < d and let P € J~{'^) on a homogeneous 
group of step d. Let ^ G V* with l^^^l > 1. Let k be the smallest index such that 
\(,j\ ^ \^d\ for k < j < d. We shall write 

X — (x , X ) — (xi , . . . , Xfc_x [x/j, . . . , Xd), 

and 

^ = (e',o = (ei,---,6-i|6,...,ed). 

Therefore 

(1-9) \C'\i = m + --- + \Ck-i\^\C\i, \e\ = \^k\ + --- + \U\^\U\ 

for 1 < i < - 1. 

Let ■0j be a compactly supported smooth fuction in the Xj-variable, and let 

1p{x") ='llJk{Xk)...lpd{Xd)- 

We also assume that ipP = P. The distribution 

<P^J> = J f{x')e~'-'"^"p{x',x")dx'dx" 

f{x')e-'''"^" 4^{\^"\x")P{x' ,x") dx'dx" 



is in . . . , uniformly in i? = |^"| > j^^l > 1 so that by induction 

hypothesis and p.9|) 

\pm = \m') < cie'r'=+-+^ie'ir • • • 

<Cl|elr•••lel^'LYlelfc^•••IC^ \^d\>i. 

As before, we remove the restriction {£^^1 ^ 1 by invoking the uniformity of the 
dilates of P. 

Let ip he a Schwartz class function in the ^j-variable. By induction hypothesis 
again, the distributions 

R->'^ < Pj, f>=J • • • , Ci-i, ...,U)dC 

which are the Fourier transforms of 

R-N < Pj,g >= R"^ J if^ {R~'^xj)g{xi,. . . ,Xj-i,Xj+i,. . . ,Xd)dx, 

are bounded in J^{fii, . . . . . . , fid) uniformly in i? > and \\(p'^\\ = 1 for 

a suitable norm in SiVj), which proves the cancellation property and completes 
the proof. □ 

Let us observe that if ^4 € J^(^) and B G J^ii^) and Uj + fij > —Qj, 1 < 
J < d, then the product of their Fourier transforms, which is well defined almost 
everywhere, is locally integrable, and 

A- B e T{-Qi - /ii - 1^1, . . . , -Qd - fJ-d- Vd), 

and therefore, by Proposition [T31 A-B = C, where C S J-"(/i + z^). By Lemma [1.6[ 

C = hm As * B, 
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SO it can be regarded as an extended convolution of A and B. Of course, C = 
A-kB, if, e.g. A has compact support. 

In the next section we show that it is still so if the vector group structure on V 
is replaced by that of a noncommutative nilpotent group as long as it is congruent 
with the homogeneous structure. 



2. Convolution 

From now on we assume that ^ is a homogeneous Lie algebra with respect to 
the dilations which are now supposed to be automorphisms of V. We have 



^^-^^J^l {0}, if p^+Pj^V, 



where V = {pj ■ 1 < j < d}. 

We shall also regard y as a Lie group with the Campbell-Hausdorff multipli- 
cation 

xy = X + y + r{x, y), 

where r{x,y) is the (finite) sum of terms of order at least 2 in the Campbell- 
Hausdorff series for V. 

We say that a tempered distribution A on V belongs to the class S{iy), if its 
Fourier transform A is smooth and satisfies the estimates 

iD'^mi < (1 + ICIi)'^^"'"^' • • • (1 + m"'-^'''^, ah a. 
The space S{i') is a Frechet space if endowed with the family of seminorms 

A^ sup sup(l + |C|i)-'^i+l"il...(l + |e|d)-"''+l"''l[Z)"i(OI, 

\a\<N^eV* 

for € N. Apart from the Frechet convergence, it is convenient to consider the 
C°°-convergence on Frechet bounded subsets of S{i^). 

2.1. Proposition. The mapping 

Sip) X S{i^) 3 (^1, Aa) ^ Ai ★ ^2 G S{fi + z^) 

defined initially for the Schwartz functions extends uniquely to a mapping which 
is contiinuous when all the spaces are endowed with either of the above defined 
convergences. 

Proof. This follows from Corollary 5.2 of [3]. O 

Let ^ be a distribution on V. Let ip £ C^{V) be equal to 1 in a neighbourhood 
of 0. Recall that for e > 0, we write ^Peix) = fi^x) and A^ = ipeA. The following 
is the main result of this paper. Note that the restriction we impose in the second 
part of the statement refers to the sum of the exponents and not to the exponents 
themselves. 

2.2. Theorem. Let A G J^{i^) and B € J~ip)- Then the functions 

$,(0 = A^iC) 
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are convergent in C°°(y*) away from the hyperspace = to a smooth function 
^ satisfying the estimates 

where the bounds depend only on those of A in and of B in T{fi). If, 

moreover, fJ,k + t^k > ~Qk for all 1 < k < d, then $ is locally integrable, and 

where the limit is understood in the sense of distributions. 

Proof. Let as first assume that A has compact support. Let h G C^{V^) be 
supported where 1/2 < < 4 and equal to 1 where 1 < \^d\ < 2. Let 

Then Ai £ S{i'), Bi £ S{iJ,), and, by Proposition I2.1[ there exist constants Ca 
such that 

\D"{A7Bm\ = \D"{Ar^^m\ 

< c^ieir^"*'"'"'' • • • 1^1^''+^'*"'"'*', 1 < \Cd\ < 2. 

Note that 1 + |^| ~ |^| on the set where ~ 1. The famihes At{x) = 
t-Q-^A{t-^x) and Bt{x) = t'^-^'Bit-^x), where n = ^Li ^k, rn = J2k=il^k, 
satisfy the estimates 

and 

uniformly in t > so that 

< c^ieir^'^^"'"^' . . . t < \Cd\ < 2t, 

for arbitrary t > 0. 

It follows that A^-k B satisfy the above estimates uniformly in e > and 
converge to some $ in C°° on V*" away from = 0. The other part of the claim 
follows by Proposition 11.71 □ 

2.3. Corollary. Let A G J^{i^) and B G If A is compactly supported, and 

l-i-k + '^k > —Qk for all 1 < k < d, then A-k B £ ^(/x + z^) . 

Let us consider the following example, where V = R. Let 



«i<i vw\ ■ 

Then A G 1/2), but "yl*j4" does not satisfy the cancellation condition. In 
fact, let / be supported in [—1,1]. The function <I> from the proof of Theorem 
2.2l is here equal to $(^) = I'^l^^- Any extension of $ to a distribution on R is of 
the form 



I5l<i ? J\i\>i C 
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SO that, for R > 1, 

-'I«I<1 l?l 

The last expressfon is unbounded as i? — >■ oo, which shows that B does not satisfy 
the cancellation condition. 

We can extend the law of composition to the distributions ^ on y such that 
A is smooth away from the hyperspace = and 

for some v = {ui, . . . , Vd)- Let us denote the class of such distributions by J"o(^)- 
Elements of J-o{v) can be interpreted as operators on a suitably chosen space of 
test functions. In fact, let SdiV) denote the closed subspace of SiV) consisting 
of functions / with 

/ f{x)p{xd) dxd = 

for all polynomials in the x^- variable. It is not hard to see that every A G J'Q{y) 
can be regarded as a continuous linear form on this space acting by 

<A,f>=lim f{x)A{x)dx. 

Moreover, the convolution operator 

TA{x) = f*A{x) = J f{xy)A{dy) 

is continuous. If A, B belong to J-o(i^), then T4 = Tg if and only if A — is 
supported where ^d = 0. Therefore, strictly speaking, the convolution operators 
Ta correspond to the classes of equivalent distributions. 

2.4. Corollary. Let A G J'Q{y) and B G Then there exists aC (z J-q{v+^) 

such that 

TaoTb = Tc- 

Proof. It is sufficient to observe that the argument of the proof of Theorem 12.21 
works here as well and yields a function $ satisfying the desired estimates. More- 
over, $ admits extension to a distribution on V* . □ 
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